1 link tagged with all of: mini apps + webmcp + gemini + voice harness + operating system
Links
The author built a voice-driven web runtime where a local daemon bridges a live Gemini model to the browser and the OS, letting them run sandboxed mini-apps, edit project files, and hand tasks to other agent harnesses. It's a working prototype of what an AI-first operating system might look like, with the prompt-injection risks left unsolved.
- Voice is faster than typing for loading context into an LLM, so the author built a voice harness that listens while they keep working and can be interrupted mid-response.
- Architecture: a browser page captures mic and screen, a local node daemon holds the API key and runs tools, and file writes route to OPFS, a picked folder, or disk depending on where the project lives.
- Mini-apps are model-written HTML in two nested iframes with a locked-down sandbox, and extensions are JSON descriptors over six primitives so the model never sees API keys.
- The author has no safeguards yet against prompt injection; anything on a shared screen or web page can reach the model and trigger tool calls to email and system settings.
voice harness
mini apps
webmcp
gemini
operating system